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We examine the effect of additive noise and drift in the dynamics of a chaotic driving signal 
on the synchronization of a chaotic response systems. Simple scaling laws associated with the 
synchronization deviation level under these types of contamination are presented. Time series used 
as the driving signals are experimentally measured from an electronic circuit and a vibrating wire. 
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I. INTRODUCTION 

Synchronization between two chaotic systems has received considerable attention in recent years. In most of this 
work synchronization of chaos has been associated with identical, chaotic in time, behaviors brought about by coupling 
two or more identical systems in a drive/response manner [1,2]. (There are far too many papers on this subject to 
present a listing of all useful references. A partial listing can be found in the paper by Heagy, Carroll, and Pecora [3] 
or our longer paper [4]. The topic is also discussed in the review by Abarbanel et. al. [5].) Unless otherwise specified 
synchronization will mean this form of identical synchronous motion of identical systems. 

This letter examines the following questions regarding the appearance of deviations from identical synchronous 
motion: (1) How will additive noise in the driving signal effect synchronization between the systems? (2) How 
will small differences between the dynamics of the driving and response systems effect synchronization between the 
systems? Similar questions have been addressed by others [2,6]. 

To date, the primary suggested application for synchronization involves communications [7-9]. All of the proposed 
communication methods that use a chaotic carrier to mask the signal of interest require synchronization (identical 
synchronous motion) between the transmitter and the receiver. Noise in the transmission channel, or difference in 
the dynamics, will introducing deviations from synchronization which are not part of the signal of interest. The two 
questions we address also have application when synchronization is used as a form of nondestructive testing, failure 
monitoring, and system identification [4]. 

Our research uses numerical models constructed from experimentally measured time series data as the response 
system [10]. Time series measurements are also used as the driving system. The "working phase space" is the one 
where the global dynamics is being modeled [5,11]. Typically, the working phase space is a rf dimensional Euclidean 
space reconstructed from time series measurements. Let the unknown dynamics of the driving system in the working 
phase space be represented by 

The only thing known, a prion, about G are time series measurements. Let the dynamics of the model in the same 
phase space be represented by 

I = ^w- (2) 

Figure 1 is a pictorial example of an attempt to synchronize a model to a time series. To generate this picture a 
time series from an electronic circuit (see Section III) is used to construct a model, Eq. (2), of the dynamics of the 
circuit. Next, we recorded x, a second trajectory from the circuit. F and x were used to generate new trajectories, 
w and y. The trajectory, w, results when the first point in x is used as an initial condition and the model, Eq. (2), 
is integrated forward in time without driving. The trajectory, y results when the model is driven by x (using the 
driving method discussed in Section II). 



The lower curve in Fig. 1 is |zp = |x — yp. The upper curve is |zp = |x — wp. The fact that the distances shown 
in the lower curve are small, when compared to those in the upper curve, indicates that the deviations from identical 
synchronous motion are small. 

In the complete absence of noise and modeling errors we expect |zp = 0, and the lower curve in Fig. 1 resides at 
— cxD. However, since noise is always present in the driving signal and there are always modeling errors, two physical 
devices can only be almost synchronized. As either the size of the noise or the size of the modeling errors increases 
the level of the lower curve in Fig. 1 rises. Understanding the behavior of this rise as a function of noise and modeling 
errors will answer questions (1) and (2). 



II. THEORETICAL CONSIDERATIONS 



Assume that, in the working phase space, Eq. (1) represents the true dynamics of the device that is producing the 
driving signal. The driving signal, x + cru, is the sum of the clean dynamics, x, and the noise, cru. The size of the 
noise is given by a while u is a signal of unit size. Now assume that a model, Eq. (2), has been constructed from a 
time series which is not the same as the driving time series (although they may have the same source) [10,12]. 

By dissipatively coupling F to the driving signal via 



1 = ^'^' 



E • [y - (x + (Tu) 



(3) 



it is possible to almost synchronize F to x [10,13]. The coupling matrix E has only one nonzero element, Efif} = e, 
where xp + arj is the (3 component of the driving signal. Synchronized, or almost synchronized, motion may only be 
possible within some finite range of e. Under these conditions using a value of e that is too small or too large will not 
produce synchronous, or almost synchronous motion [2,10,13]. Thus, errors in modeling and noise are the causes of 
any lack of complete synchronization in Eq. (3). For our numerical experiments the e ^ cxd limit still results in near 
synchronization when (3 is chosen to be d, the last component of the driving vector. 

By definition, the model is synchronized to the time series, x, if x = y and F = G for all time greater than to, a 
transient. It is easy to show that synchronization will not occur when F 7^ G and/or in the presence of noise [10]. Let 
z = y — X denote the deviations between y and the clean driving signal, x. If the deviations are small, < |zp ^ 1, 
then the linearized time evolution of z is given by 






El 



(tE -11+ AG(x) 



(4) 



where AG = F — G denotes the difference between the model and the true dynamics of the driving system. 

AG is not related to measurement errors and has two potential sources. The first source arises because for any 
real situation F is never exactly equal to G. The second source arises if the dynamics of the driving signal, G, 
is different from the dynamics that produced the time series used to make the model, G . To analytically isolate 
these two sources assume that G and G are related by some small change in the parameters of the driving system, 
G ~ G' + (SG'/Sp) • 6p. Then AG in Eq. (4) becomes 



AG(x) ~ AG'(x) ■ 



_d_ 
dp 



AG'(x) • 6p 



(5) 



and AG = F — G . The first and second terms on the right hand side of in this equation are associated with modeling 
errors and drift in the dynamics of the driving system, respectively. 

Equations (4) and (5) are the principle evolution equations for coupled systems in the vicinity of synchronized 
chaotic motion. An expression for z(t) can be obtained by formally integrating Eq. (4) [4]. 

The bottom curve in Fig. 1 indicates that the average behavior of log]^o(NP) i^ essentially constant. Therefore, we 
define the synchronization deviation level (which we sometimes call the deviation level) by 



KN 



1/2 



1 



lim 

t^oo t — t 



Jt 



|z(r)| dr 



1/2 



(6) 



At this time we make the following assumptions regarding the noise and the errors in modeling. We assume that the 
noise, and AG, are ergodic. This allows us to replace time averages by phase space averages (which will be denoted 
by brackets, ()). We also assume that the noise is stationary and completely independent of AG. The stationary 
assumption implies that the autocorrelation of the noise, k(s) = {ri(r)ri(r — s)) , is only a function of the lag time, s. 



With these assumptions it can be shown that Eq. (6) can be rewritten as [4] 



where B^ and A^ are given by 



B' 



6^(0) 



KN 



,1/2 



[A^ + {(tB) 
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/ (\U{t, r) ■ Vf) dr + 2 {[U{t, r) • V] • [U{t, r) ■ B(r)]) dr 



(7) 



(8) 



A^ = I /|U(t, r) • AG(r)p\ dr + 2 j ([U(t, r) • AG(r)] • [U(t, r) • H(r)]) rfr. 



(9) 



The three d dimensional vectors, V, B(r) = B[x(r)] and H(r) = H[x(r)] are defined in the following manner. 
V = [0, . . . , 0, 1, 0, . . . , 0] where the 1 appears as the (3 element of V and (3 is given by Ep p ^ 0. B(r) and H(r) are 
defined by 



B(r) 



m 



U(r, r — s) -^ ds 



H{r)= U(r,r-s) • AG(r-s)rfs, 
Jo+ 

where AG(r) = AG[x(r)]. The lower limit of integration, 0"*", implies taking the limit as we approach, but are never 
equal to, from the positive side. 

The matrix U(t, to) satisfies the initial condition U(to, ^o) = 1 (where 1 is the identity) and is the evolution operator 
that evolves the initial condition, z(to), forward in time from to to t in the absence of noise and modeling errors. It 
comes from the solution to the homogeneous portion of Eq. (4) and is defined by 

z(t) = exp / [DF(r)-E]rfr ■ z{to) 

Uto J 

= U(t,to)-z(to), 

where DF(r) = DF[x(r)]. Since the time evolution is stable (the system synchronizes) U(t,to) shrinks z(to) to zero 
exponentially fast as t ^ co. The rate of decrease is controlled, in a nontrivial fashion, by the coupling, e [3,14]. 

Clearly, B and A are nontrivial functions of e. In addition, 5 is a function of the type of noise in the driving signal 
but is not a function of a or the errors in modeling. On the other hand, A is a function of modeling errors but is not 
a function of the noise. The scaling law given by Eq. (7) describes the rise of the deviation level as the noise level 
increases. 

The second question asked in the introduction involved modeling errors and the effects of drift in the dynamics of 
the driving signal. Both of these effects infiuence A while neither infiuences B. Inserting Eq. (5) and the definition of 
H(r) into Eq. (9) results in 



A' ~ A'- 



d_ 
9p 



/*(|U(t,r).(AG'(r) + H'(r)) 



dr 



(5p, 



(10) 



where H is what one obtains by substituting AG for AG in the definition of H, and A''^ is what one obtains by 
substituting AG' and H' for AG and H in Eq. (9). 
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In the limit of zero noise the deviation level is just [\|zp)/Ti] = A. Thus, in this limit Eq. (10) describes the rise of 
the deviation level as the dynamics of the driving drifts. The ability to track this rise is the center of a nondestructive 
testing application we discuss in our longer paper [4]. 



III. NUMERICAL EXPERIMENTS 



In Section II we addressed changes in the synchronization deviation level as a function of noise level, a, and modeling 
errors, AG. Our numerical experiments examine each of these issues separately and are performed on data sets taken 
from an electronic circuit and a vibrating wire. 



Details about the experimental apparatus that produced the scalar time series, s(nAt) = s(n), n = 1,2, . . . can be 
found in our longer paper and references therein [4]. The time delay method 

x(n) = [s(n), s(n + T), . . . , s(n + (d - 1)T)] 

is used to reconstruct the attractors in a working phase space. The optimal time delays and embedding dimensions 
were determined using average mutual information and false near neighbors, respectively [4,15,16]. The experimental 
systems we have examined produced time series data that was embeddable in rf = 3 dimensions. 

Next we used portions of the embedded time series to constructed global ODE's in the form of Eq. (2) to serve as 
models for the dynamics on the attractors [4,10]. All of the numerical experiments used the third component of the 
embedded time series as the driving term (i.e., /3 = rf = 3 in Eq. (3). 

In our first set of numerical experiments we examined the behavior of [\|zp)^]^" as a function of cr. Each numerical 
experiment used two types of noise. The first type is gaussian noise with zero mean and unit standard deviation. The 
second type (inband noise) is constructed to have zero mean, unit standard deviation, and the same power spectrum 
as the raw time series. We also investigated two different values of the coupling constant, e. One value was chosen 
slightly above the minimum necessary for synchronization while the second was chosen well above the minimum value. 

The numerical tests used 5000 and 10,000 point time averages for the circuit and wire, respectively. The results are 
shown in Figs. 2 where we have plotted normalized deviation levels, [(|zp)^]"'^"/-D- The normalization constant, D, 
is associated with the time average of |zp when e = 0. The lines represent curves of best fit between Eq. (7) and the 
results of the numerical experiments. 

A second set of numerical experiments we performed involved determining the behavior of the deviation level, 
[(|zp') ]^", as a function of changes in the dynamics of the driving signal, AG. In order to perform our numerical 
tests we recorded six time series from the circuit each corresponding to a slightly different value of a parameter, 
tto, . . .as, (physically, a resistance is changed in the circuit). 

A model, Eq. (2), was constructed from a portion of the ag time series and then subjected to driving from each 
time series. The measured deviation levels are shown in Fig. 3, where the solid lines represent straight lines of best 
fit through the data. The solid circles, squares, diamonds, and triangles are associated with coupling strengths of 
£=1,2, 3, and 4, respectively. The open circles represent a test case with a coupling strength of e = 0.5 which is 
insufficient to synchronize the model to the driving signal. The solid symbols indicate a linear rise in the deviation 
level with respect to changes in a (|Aaj| = |ao — aj|). 

The rise in the deviation level shown in Fig. 3 is due, predominantly, to changes in the dynamics of the driving 
signal [4]. If the amplitude of the noise is small then Eqs. (7), (9), and (10) imply that 

log,o([(|zp)]^/^)^log,o(A') + i(|)'|Aa|, 

for suitably defined ^(e) (see Eq. (10)). This equation indicates that the deviation level should rise linearly with |Aa| 
as shown in Fig. 3. 

Figures 4 show A vs e for three distinct cases. The first case (diamonds) used the raw data as the driving term in 
Eq. (3) and the approximation A"^ = (|zp)„. The second two cases (circles and squares) used gaussian and inband 
noise, respectively. (Figure 4a shows results from the electronic circuit while Fig. 4b shows results from the vibrating 
wire.) To obtain A (as well as B) for a particular value of e we calculated the deviation level as a function of noise 
size (see Fig. 2). We then fitted these results to Eq. (7) [18]. The figures indicates that A is not a function of the 
type of noise in the driving. 

Figures 5 shows B vs e for inband and gaussian noise. (Figure 5a shows results from the electronic circut while 
Fig. 5b shows results from the vibrating wire.) Quantitative details about the behavior of B depend intimately on 
the type of noise that is found in the driving signal, and will change from one type of noise to the next. An important 
special case is delta correlated noise where k(s) = k(0) 6(s). When the noise is delta correlated B = and it is 
possible to obtain a compact analytic expression for B^ [4]. The figures indicate that B is essentially independent of 
e for gaussian noise and has a strong dependence on e for inband noise. 

Figures 4 and 5 show that both B and A appears to become independent of e when e gets large. This fact can 
be predicted since in the e ^ co limit corresponds to Pecora and Carroll synchronization [4,1]. A partial theoretical 
analysis of the dependence of B and A on e can be found in our longer paper [4]. 

IV. SUMMARY AND CONCLUSIONS 

This letter has investigated the behavior of chaotic synchronization in the presence of additive noise in the driving 
and drift in the dynamics of the driving. We defined a measure of the deviation from synchronization between the 



Kl 



driving signal and the response system. If the driving signal is denoted by x and the dynamics of the response system 
while being driven is denoted by y, then the synchronization deviation level is given by the following time average 

-I/O 

zp') ] where z = y — x (see Section II). 

The numerical experiments involved constructing models of the dynamics of the driving system from experimentally 
measured time series. These models are the response systems which were driven by time series data. 
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To study the effect of additive noise in the driving signal on [\|zp)/Ti] we added gaussian as well as inband noise 
of various amplitudes to the driving signal. Theoretical analysis in Section II indicates that (|zp)„ = A"^ + {(tBY 
where a is the standard deviation of the noise in the driving signal, and B and A are given by Eqs. (8) and (9). The 
results of our numerical experiments and confirmed this scaling law. 

-I/O 

To study the effects of drift in the dynamics of the driving signal on [(|zp)^] we constructed a model using 
data from the electronic circuit. The model was then subjected to driving from time series obtained from the circuit 
after making slight changes in one of its components (a resistor). The results are shown in Fig 3 and confirm the 
theoretical analysis shown in Sections II and III. 

The quantities B and A are functions of the coupling strength, e. We have presented figures displaying the 
dependence of B and A on e for both of the systems studied. A more complete analysis can be found elsewhere [4]. 
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FIG. 1. The distances between the orbits x, y, and w. The dashed line is z = |x — y| while the solid line is |x — w| . Near 
synchronization between x and y is clearly demonstrated. The driving variable is xs and e = 20. 

FIG. 2. The normalized synchronization levels as a function of added noise level. The circles and squares correspond to 
gaussian and inband noise for the smaller value of e, respectively. The diamonds and triangles correspond to gaussian and 
inband noise for larger value of e, respectively. For the circuit we used e = 5 and 20 while for the wire we used e = 0.75 and 3. 



FIG. 3. The synchronization level as a function of Aa and the coupling strength, e. Each change in Aa represents an change 
in the dynamics of the driving signal of approximately 1 %. 

FIG. 4. A Ys c. A has been calculated using raw data (the diamonds) data with gaussian noise (the circles) and data with 
inband noise (the squares), (a) Results for the electronic circuit, (b) Results for the vibrating wire. 

FIG. 5. A graph of 5 vs e for gaussian (the circles) and inband noise (the squares), (a) Results for the electronic circuit, 
(b) Results for the vibrating wire. 



